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DESCRIPTION 

Automatic contrast medium control in images 

The present invention relates to the field of digital imaging. In particular, the present 
invention relates to a method of processing a series of x-ray images of an object of 
5 interest, to an image processing device and to a computer program for processing a 
series of x-ray images of an object of interest. 

In diagnostics and therapy of, for example, a coronary heart disease, projection x-ray 
images acquired in so-called cine imaging mode play a crucial role. To make the 
10 coronary arteries visible in such coronary angiographies, a radio-opaque contrast 

medium is applied by means of a catheter placed, for example in the entrance to a main 
coronary artery. Pre-interventional coronary angiographic sequences showing the 
coronary vessel tree during several heart cycles serve as diagnostic images to detect 
stenoses, and as roadmaps for the intervention itself. 

15 

During the intervention, a catheter or a guide wire is advanced under x-ray monitoring 
through the vessel to the lesion. Only occasional bursts of contrast agent for verification 
purposes can be given while this procedure is performed. To help navigation, a single 
frame showing the entire vessel tree filled with contrast agent is therefore selected 
20 manually from the pre-interventional angiograms to serve as a roadmap and is displayed 
on a screen next to the interventional live images. This roadmap, however, is naturally 
static and is hence not consistent with the instantaneous heart and respiration status in 
the live images. Due to this, a navigation of the catheter or the guide wire is difficult 
since the roadmap does not match the interventional image. 

25 

It is an object of the present invention to provide for an improved processing of a series 
of x-ray images of an object of interest, where the object of interest is visible due to a 
contrast medium. 
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According to an exemplary embodiment of the present invention as set forth in claim 1, 
the above object may be solved with a method of processing a series of x-ray images of 
an object of interest, wherein the object of interest is visible due to a contrast medium, 
wherein, according to the method, an image of the series of x-ray images where the 
5 object of interest is not sufficiently filled with the contrast agent is automatically 
determined. 

Due to this automatic determination, images, for example, of the coronary angiograms 
can be determined where the vessel tree is sufficiently filled with a contrast agent. Such 
10 images may then be preferably displayed as live images, for example, for catheter 

navigation. However, a couple of images where the vessel tree is sufficiently filled with 
contrast agent may be overlaid to produce an image where the complete vessel tree is 
visible. Also, images maybe automatically determined where the complete vessel tree is 
filled with contrast agent 

15 

According to another exemplary embodiment of the present invention as set forth in 
claim 2, a pre-processing of the images is performed such that a background of the 
object of interest is at least partially suppressed. Furthermore, enhancement of part of 
the object of interest may be performed 

20 

According to another exemplary embodiment of the present invention as set forth in 
claim 3, a morphological filtering is performed and an accentuation of part of the object 
of interest visible in the respective images of the series of x-ray images is performed on 
the basis of a motion of the object of interest. Preferably, this may allow for an 
25 improved image quality. 

According^to^other exemplary-embodimentof the present4nvention^ssetforth-in 

claim 4, first and second order derivatives of images are used to enhance image 
information relating to the object of interest. 



30 
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Furthermore, this may allow to further improve an image quality such that, for example, 
in coronary angiograms the vessel tree displayed has an improved image quality. 

According to another exemplary embodiment of the present invention as set forth in 
5 claim 5, a determination with respect to whether the object of interest is sufficiently 
filled with contrast agent is performed on the basis of a number of picture elements of 
the image having a pixel value exceeding a pre-set threshold value. 

Advantageously, this allows for a fast and robust determination of images, where the 
10 object of interest is sufficiently filled with contrast medium. 

According to another exemplary embodiment of the present invention as set forth in 
claim 6, a determination of the image of the series of x-ray images, where the object of 
interest is not sufficiently filled with the contrast agent is performed on the basis of a 
15 histogram analysis, a feature curve analysis and a feature curve segmentation. The 
feature curve segmentation may be based on a maximum likelihood segmentation. 

This may allow for a fast, efficient and accurate determination. 

20 According to another exemplary embodiment of the present invention, a 95-percentile 
of a histogram is used to determine a feature function. Then, a second histogram is 
formed on the basis of the feature function. Then, a threshold is determined in the 
second histogram, which separates a first state of an image where the object of interest 
is insufficiently filled with contrast medium, from a second state of an image where the 

25 object of interest is sufficiently filled with the contrast medium. 

According to another exemplary embodiment of the present invention, the method is 
adapted for determining images of coronary angiograms where the vessel tree of the 
heart is sufficiently filled with contrast agent 



30 
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Claim 1 1 relates to an image-processing device according to another exemplary 
embodiment of the present invention, which may allow for an improved operation, for 
example, in conjunction with coronary angiograms and/or catheter navigation. 

5 The present invention relates also to a computer program, for example, to an image- 
processing device for processing a series of x-ray images of an object of interest. The 
computer program according to the present invention is defined in claim 12. The 
computer program according to the present invention is preferably loaded into a 
working memory of a data processor. The data processor is thus equipped to carry out 
1 0 the method of the invention. The computer program may be stored on a computer 
program medium such as a CD-ROM. The computer program may also be presented 
over a network such as the WorldWideWeb, and can be downloaded into the working 
memory of a data processor from such a network. The computer program may be 
written in any suitable programming language, such as C++. 

15 

In the following, what might be seen as the gist of an exemplary embodiment of the 
present invention is described with respect to the exemplary identification of complete 
vessel tree in coronary angiograms. First, a feature map where the vessel regions have 
been enhanced is created. Then, a vessel enhancement is based on the above 

20 observations and vessels are the locally darkest oriented structures with significant 

motion. A background is then equalized by a morphological top hat transformation with 
a structuring element comparable to the diameter of the last vessel. Then, a vessel 
motion is exploited to increase the contrast between background and vessel. Vessel 
borders are amplified by calculating a gradient norm, while vessel centers — which do 

25 not respond to first derivatives - are enhanced by a second derivative operator. The 
resulting enhanced images can be regarded as containing two classes, namely bright 

vessels-and-dark-baekgroun^ 

segmentation. 
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According to an exemplary embodiment of the present invention, a histogram of the 
enhanced images is determined and the 95-percentile of these histograms is used as a 
feature. The more area in an image is covered by contrast agent, the higher the 95- 
percentile- When plotted over time (i.e. the frame number of the images), the feature 
5 curve clearly shows the following phases: an in-flow of the contrast agent; a filled state, 
where the vessel tree is sufficiently filled with contrast agent, and an out-flow, where 
the contrast agent is washed out of the vessel tree. This feature curve is then segmented. 

According to an exemplary embodiment of the present invention, the observations in 
10 each of these three states is modeled by a polynomial and then, a segmentation is 

performed, which allows the best fit of three polynomials as measured by a maximum 
likelihood criterion. 

According to another exemplary embodiment of the present invention, the state 
1 5 sequence is modeled by a Hidden Markov model and is estimated by a maximum a- 
posteriori (MAP) criterion. 

These and other aspects of the present invention will become apparent from and 
elucidated with reference to the embodiments described hereinafter. 

20 

Exemplary embodiments of the present invention will be described in the following, 
with reference to the following drawings: 

Fig. 1 shows a schematic representation of an image-processing device according to an 
25 exemplary embodiment of the present invention, adapted to execute a method according 
to an exemplary embodiment of the present invention. 

Fig. 2 shows a block diagram of a spatio-temporal filtering chain according to an 
exemplary embodiment of the present invention. 

30 
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Fig. 3 shows a processing chain with first and second order derivatives as implemented 
according to an exemplary embodiment of the present invention- 
Fig. 4 shows vessel map logarithmic-Mstograms for an in-flow frame (a) and a filled 
5 state (b) according to exemplary embodiments of the present invention. 

Fig. 5 shows a percentile feature of a frame index (a) filtered by a FIR low pass filter of 
length 7 (b) according to an exemplary embodiment of the present invention. 

10 Fig. 6 shows a histogram of the 95-percentile feature curve depicted in Fig. 5b 
according to an exemplary embodiment of the present invention. 

In the following, the present invention will be described with respect to a statistical 
model based identification of complete vessel tree frames in coronary angiograms. 
15 However, it should be noted that the present invention is not limited to this application, 
but may be applied to any imaging applications where the object of interest is made 
visible by application of a contrast medium such as x-ray imaging, ultra sonic imaging 
or MR imaging. 

20 Fig. 1 depicts an exemplary embodiment of an image processing device according to the 
present invention, for example, executing an exemplary embodiment of the method in 
accordance with the present invention. The image-processing device depicted in Fig. 1 
comprises a central processing unit (CPU) or image processor 1 connected to a memory 
2 for storing time series x-ray images. The image processor 1 may be connected to a 

25 plurality of input/output network or diagnosis devices, such as an x-ray scanner. The 
image processor is ftirthermore connected to a display device 4 (for example, a 

computer monitor) for d^ 

image processor L An operator may interact with the image processor 1 via a keyboard 
5 and/or other input/output devices, which are not depicted in Fig. 1. 

30 
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According to an exemplary embodiment of a method of operating the image processing 
device depicted in Fig. 1, the image processing device firstly performs a vessel 
enhancement The vessel enhancement firstly comprises a morphological filtering and 
then an exploitation of the motion of the vessel tree. Then, vessel information is 
5 enhanced in the angiograms by using first and second order derivatives of the 
angiograms. 

Then, after the vessel enhancement, a histogram analysis and feature curve analysis is 
performed. 

10 

In a next step, feature curve segmentation is performed The feature curve segmentation 
may perform maximum likelihood segmentation and/or segmentation on the basis of a 
Hidden Markov model. 

1 5 This will be described in further detail in the following: 

Vessel enhancement 

20 Morphological filtering 

A first step towards enhancing vessels with respect to background exploits the property 
that, being filled by a radio-opaque contrast agent, vessels are locally darker than their 
immediate surroundings. In order to flatten the varying background intensity, a 

25 background image is calculated by removing foreground structures. To this end, a local 
sliding maximum filter is firstly applied, the dimensions of which are slightly larger 
than the largest expected vessel diameter. This operation removes locally dark 
structures, which are smaller than the size of the filter. However, edges of larger dark 
regions bordering on brighter regions are also eroded, i.e. moved towards the inside of 

30 the dark region by approximately the size of the filter. An example of such a region in 
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coronary angiograms is the diaphragm, which usually appears as a dark half disc in the 
lower portion of the angiograms. 

To reconstruct such eroded edges, a local sliding minimum filter of the same size may 
5 be applied, which propagates the boundary back to its approximate original location. 
Maximum and minimum filters may be applied in windows of a pre-detennined size 
and implemented as successive horizontal and vertical ID filters in order to save 
complications. 

10 The filtered images then contain almost no foreground information. Subtraction of the 
original frame from its maximum - and minimum - filtered background version thus 
leaves the foreground vessel information. The succession of maximum and minimum 
filtering may be referred to as morphological closing and taking the difference between 
the original and its closing may be called top hat filter. Due to the maximum filter 

1 5 applied in the first filtering step, the gray level at each pixel in the closing-filtered image 
is never smaller than the gray level of the same pixel in the original. The gray levels in 
the top hat filtered image are therefore non-positive. 

Exploiting motion 



As has been found out according to the present invention, an additional clue to vessels 
is their mostly strong and jerky motion, which is caused by the beating heart. When the 
vessel moves to a new position, absorption at this position will increase due to the 
contrast agent within the vessel. Therefore, when calculating the pixel-wise difference 

25 image between any given frame and its predecessor (or between the current frame and a 
frame some fixed distance back in time), pixels with the new vessel positions will tend 

to exhibitrnegative-diffe^^ 

tend to show positive differences. This effect is even more pronounced in top hat 
filtered angiograms, since the top hat filter reduces background structures, which would 

30 cause clutter in the difference images when moving themselves. Therefore, positive 



20 
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values in the difference image are clipped to zero and then, the clipped difference image 
is added to the current top hat-filtered frame. The overall result is a tendency to make 
the vessels even darker. Local minima of small extent, which is unlikely to be caused by 
moving vessels, can optionally be removed by a morphological closing, for example, 
5 with a 3 x 3 structuring element A block diagram of the processing chain described 
above is shown in Fig. 2. 

The block diagram of the spatio-temporal filtering chain described above is depicted in 
Fig. 2. X n denotes an n-th incoming angiography frame and Y n its top hat filtered 
10 version. After subtracting its predecessor Y n _i from Y n , positive differences are clipped 
towards zero. After optional weighting and closing, the result is added to Y n . 

First and second-order derivatives 

15 To enhance vessel information in the angiograms after spatio-temporal processing by 
top hat filtering and motion analysis, a combination of first and second order derivatives 
may be used to enhance vessel information. Taking a magnitude of the first derivative 
of the angiograms images evidently captures the steep slopes at the vessel borders, but 
naturally fails to respond to the flatter portions of the profile within the vessel. 

20 Therefore, the first order derivative is complemented by a second-order derivative. 

Since the second-order derivative captures the middle of the vessel, both derivatives are 
added to obtain a response over the entire vessel profile. 

In a 2D-image f(x, y), the absolute first derivative is replaced by the norm |A f(x, y)| of 
25 the gradient. Gradient information is computed from the eigenvalues M and A2 of the 2 
by 2-tensor T introduced for orientation analysis. Apart from the gradient, the 
eigensystem of this tensor provides also information on the local structure of the image 
signal, like orientation, homogeneity and corners. In continuous coordinates, the tensor 
T is given by 



30 
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where Q is a small local window. In discrete coordinates, the horizontal and vertical 
derivatives are first calculated using symmetric finite difference kernels. For the entries 
5 along the main diagonal of T, these derivatives are squared, while the entries on the 
counter-diagonal are given by the pixel-wise product of horizontal and vertical 
derivatives. Finally, the integration over SI is realized by a lowpass filter of appropriate 
size. The gradient norm is then given by the square root of the sum of the eigenvalues, 
i.e. 




In addition, the eigenvalues can be used to distinguish three different types of structure: 
if both eigenvalues are (close to) zero, the local structure in the support window Q is 

15 flat. Ef the eigenvalue XI is large, while the smaller eigenvalue XI is (close to) zero, i.e. 
rank(T) = 1, there is a structure with a unique orientation in Q, caused, e.g., by a locally 
straight vessel. In this case, the eigenvectors run parallel respectively perpendicular to 
the orientation. Finally, if both eigenvalues are relatively large, T is not rank-deficient. 
Then, there is only one local orientation, caused by a sharply bending vessel projection. 

20 The gradient norm fails to respond to the vessel middle. Therefore, the gradient norm is 
complemented by the Laplacian 




25 which is linear, shift-invariant and, in its continuous version, isotropic. This operator 
hence responds to vessel ridges independent of their orientations. As a discrete 
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approximation to the Laplacian operator, a difference of Gaussians (DoG) filter is used, 
which is an approximation to a combination of the Laplacian with a Gaussian lowpass 
filter, or so-called Mair-Hildreth operator. The result of filtering the top hat prefiltered 
image by this operator is added pixel-wise to the gradient-norm image. 

Both computation of the gradient norm via the tensor T and the second derivative 
involve lowpass filtering. On the one hand, this makes the processing results more 
robust with respect to noise, while on the other hand, it blurs vessel edges. The top hat 
filter, however, preserves edges. In a final step, the sum image is therefore multiplied by 
the top hat-filtered image to reduce the blur of the vessel edges. A block diagram of this 
processing chain is depicted in Fig. 3. 

Histogram analysis and feature curve 

As found according to the present invention, a presence of contrast agent increases a 
frequency of occurrence of bright intensity in the vessel map. Therefore, vessel map 
histograms are analyzed over the time — i.e. frame index — to obtain a time dependent 
feature curve related to the presence of contrast agent. Since vessels filled by contrast 
agent cover about 5% of the total image area, as has been found according to the present 
invention, a 95-percentile of the histograms was chosen as scalar feature. The presence 
of contrast agent increases tails of the vessel map histograms and thus also the 95- 
percentile. The three states in-flow, filled state and out-flow are thus visually readily 
identifiable in the feature function formed over the frame index. 

This may be taken from Figs. 4a and 4b and from Figs. 5a and 5b. Figs. 4a and 4b show 
logarithmic vessel map histograms for an in-flow frame (a) and a filled-state frame (b). 
Thus, two different states are depicted. It should be noted that the present invention is 
also applicable for a plurality of states, for example, in a sequence. E.g. an inflow state, 
a filled state and an outflow state maybe determined. The 95-percentile in Figs. 4a, 4b, 
5a and 5b is given by the arrows. 
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As may be taken from Figs. 4a and 4b, the 95-percentile in Fig. 4a is approximately 45 
and the 95-percentile in Fig. 4b is approximately 63. The abscissae in Figs. 4a and 4b 
map the gray values in the image of interest The ordinates of Figs. 4a and 4b map the 
frequency of these gray values. The abscissae in Figs. 5a and 5b relate to the frame 
5 numbers of the images and the ordinates relate to the 95% percentile determined on the 
basis of a histogram of the preprocessed image as in Figs. 4a and 4b. 

The evolvement of the percentile feature over time is depicted in Fig. 5, where Fig. 5a 
depicts the percentile feature over the frame index and Fig. 5b shows the same 
10 percentile feature over the frame index but filtered by a FIR low pass filter of length 7. 

As may be taken from Figs. 4a and 4b and Figs. 5a and 5b, two states, in-flow and filled 
state, are visually readily identifiable. Also, it may be taken from the Figs. 4a, 4b, 5a 
and 5b that the area covered by the vessels - and thus the percentile - depends on the 
15 heart cycle, since the filled state exhibits a periodic oscillation. 



Feature curve segmentations 

20 Since each of the states in-flow, filled state and out-flow must form a coherent region, 
the feature curve as depicted in Figs. 5a and 5b, but preferably the filtered feature curve 
depicted in Fig. 5b, is segmented into three regions. For a feature curve of length N, 
there exists 




different segmentations. For a typical length of N = 70, one obtains N = 2415 possible 
segmentations. 
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Maximum likelihood segmentation 

One possibility to segment the feature curve is by least-squares fitting three polynomials 
of a given degree to the feature curve. Under Gaussian assumptions, this is equivalent to 
5 a Maximum-Likelihood (ML) segmentation. The use of Ml^estimation rather than 

seeking the Maximum a Posteriori (MAP) estimate may be justified by the above strong 
coherency constraint on the solution. Denoting the succession of states by Q = 
{q x , , q N } , where q* is the state label for the /th frame of the angiogram, and the 

sequence of percentiles by S ={s x ,... 9 s N } 9 with Si being the percentile observed for the 
10 fth angiogram frame, the solution Q which obeys 




is sought 



15 

Here, j = 1, 2, 3 is the index of region Rj , and Sj is a vector with ordered observations in 
each region. Modeling the observations as Gaussian distributed, mj and a) are the 

region-specific parameters of the distribution. Also, the realistic assumption has been 
made that the observations are region-wise independent Furthermore, it is assumed that 
20 the observations within each region are conditionally independent, i.e. that their 

dependencies are fully captured by the coherency of the region. Then, for the region 
likelihood, the following maybe obtained: 




25 
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Estimating the unknown region parameters mj and crj by 




5 where Nj is the number of frames in region Rj , and replacing the true parameters by 
their estimates, Eq. (6) yields 





where all constants and factors not influencing the maximization have been dropped, 
1 5 and where it has been have taken into account that Nl +N2 +N3 = N. Evidently, this 
formulation seeks the segmentation which permits fitting a polynomial of degree zero 
optimally - i.e. with minimum mean square error as defined by Eq. (7) - to each region. 

An alternative is to segment such that a polynomial of degree one can be fit best to each 
20 region. Then, each region mean mj is replaced by the slope a$ and the mean bj , and the 
likelihood for each region becomes 
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With the estimates 




one again gets 





These equations, which must be solved for a j and b j , can be decoupled when centering 
the region-internal coordinate n such that 




This yields 




The sought segmentation is then given by 
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For fitting polynomials of degree two, it may be switched to a matrix notation. With the 
fitting error 




for region Rj may be obtained 
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The criterion to optimize is again given by Eq. (17), with the variance estimate given by 
Eq. (21). Extension to polynomials of higher degree is obvious. 

5 For each segmentation, the optimal fit can thus be determined. The ML-segmentation is 
the one with minimum optimal fitting error. Since the number of possible segmentations 
is limited by the coherency constraint (Eq. (4)), full search is practically feasible. 

1 0 Segmentation by a Hidden-Markov Model 

The Hidden Markov model (HMM) describes a random state sequence, which can only 
be observed through another random process conditioned on it. In the above case, the 
observable random process is the 95-percentile computed from the vessel map 
15 histograms. The underlying, hidden process is modeled as a two-state sequence, which 
indicates whether or not the coronary vessel tree in an angiography frame is ftdly filled 
by contrast agent. It should be noted that sequences with a plurality of states, e.g. 3 or 
more, may also be modeled. The HMM is then parameterized by 

20 • the 2x2 state transition probability matrix A = [ay] 

• the probability density functions (pdf) pk(s), k = 1 , 2, of the observations 
conditioned on the states, and 

• the initial state probability vector H = [it l9 raj 

25 

Thus, the optimum state sequence Q subject to the MAP criterion is determined, i.e. 
such that P(Q|S) is maximum. To estimate the conditional pdfs pi(s) and p2(s), it is 
assumed that the histogram of the feature curve consists of two Gaussian densities. This 
30 histogram is thresholded by Otsu's algorithm such that the separability between the two 
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classes is maximized. An example histogram is shown in Fig. 6. From this initial 
histogram, the threshold is found to 57. Once hard thresholding is carried out, mean and 
variance of the conditional pdfe as well as prior state probabilities 7Ci and tu 2 can be 
estimated. 

5 

The a priori knowledge is now predominantly expressed via the state transition matrix 
A, with the transition probabilities such that staying in the current state is strongly 
encouraged. Empirically, A was determined as 




Two different optimization algorithms were implemented: the first approach uses the 
Viterbi algorithm to optimize over all possible state sequences, without considering the 
coherency constraint. The probability for assigning a certain sequence of labels 
15 G = tei,$2- -><1n) to a certain sequence of frames i l9 i 2 „.j N is 

P(Q)= n^to) />(ft-i -> ft) 

with q e {*,/} , i denoting inflow and / denoting filled state. p(q{) is the probability of 
20 frame I % being of the state q t as given by the pdf that are assigning probabilities to 
percentile values (coming from Otsu's method applied to the percentile histograms). 

The transition probabilities 

^^A^JLorJ^ 

[03- qr* tfA 

25 

are given by the transition probability matrix A . 
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The computations are on the order of 4N. The coherency constraint is brought to bear 
afterwards by finding the state sequence consistent with the coherency constraint which 
is closest in Hamming-distance to the solution found by the Viterbi algorithm. The 
second option proceeds similar as done for the above Maximum-Likelihood approach 
5 by carrying out a full search over all possible sequences consistent with the coherency 
constraint. Here, the N 2 /2 different sequences need to be tested. In practice, both 
optimization methods gave very similar results. Note, however, that the Viterbi-based 
approach is more flexible when the coherency constraint is violated, e.g. 
by giving several bursts of contrast agent. 

10 

Advantageously, the above described method and image processing device allow for an 
identification of complete vessel tree frames in coronary angiograms in an automatic 
manner. Furthermore, the above described method and operation may be applied to 
other applications, where objects, preferably moving objects of interest are imaged by a 
1 5 time series of images where the object of interest is visible due to a contrast medium. 
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CLAIMS 



1 . Method of processing a series of x-iay images of an object of interest, wherein the 
object of interest is visible due to a contrast medium, the method comprising the step of: 

automatically determining an image of the series of x-ray images where the 
object of interest is not sufficiently filled with the contrast medium. 

5 

2. The method of claim 1, further comprising the steps of: 

enhancing parts of the object of interest visible in respective images of the series 
of x-ray images; 

preprocessing the respective images of the series of time series x-ray images 
10 such that a background of the object of interest is at least partly suppressed. 

3. The method of claim 2, further comprising the steps of 

performing a morphological filtering and 

performing an accentuation of parts of the object of interest visible in the 
15 respective image of the series of x-ray images on the basis of a motion of the object of 
interest 

4. The method of claim 2, further comprising the steps of: 

enhancing image information relating to the object of interest on the basis of 
20 first and second order derivatives of the respective image of the series of x-ray images. 

5. The method of claim 1, 

wherein a determination of the image of the series of x-ray images where the 
object of interest is not sufficiently filled with the contrast medium is performed on the 
25 basis of a number of picture elements of the image having a value exceeding a preset 
threshold value. 
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6. The method of claim 1, 

wherein a determination of the image of the series of x-ray images where the 
object of interest is not sufficiently filled with the contrast medium is performed on the 
5 basis of a histogram analysis, a feature curve analysis and a feature curve segmentation, 

7. The method of claim 6, 

wherein the feature curve segmentation is performed by using a maximum 
likelihood segmentation. 

10 

8. The method of claim 1, 

wherein the series of x-ray images is a time series of x-ray images; 

wherein first histograms of the time series of x-ray images are analyzed over the 
time to obtain a time dependent feature curve related to a presence of contrast medium 
15 in the object of interest; 

wherein a 95 percentile of the first histograms is used to determine a feature 
ftmction; 

wherein a second histogram is formed of the feature function; 

wherein a threshold is determined in the second histogram which separates a 
20 first state of an image where the object of interest is filled insufficiently with the 
contrast medium from a second state of an image where the object of interest is 
sufficiently filled with the contrast medium; and 

wherein a transition matrix is determined for describing a probability that the 
first state changes to the second state. 

25 

9. The method of claim 8, 

wherein the second histogram is modeled by means of a plurality of Gaussian 
distribution density functions such that a probability is determined for values of the 95- 
percentile relating to whether the respective values belong to the first state or the second 
30 state. 
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10. The method of claim 1, wherein the method is for determining images of coronary 
angiograms where the vessel tree of the heart is sufficiently filled with contrast medium. 

5 11. Image processing device, comprising: 

a memory for storing a series of x-ray images of an object of interest wherein the 
object of interest is visible due to a contrast medium; and 

an image processor for processing the series of x-ray images of the object of 
interest, wherein the image processor is adapted to perform the following operation: 
1 0 automatically determining an image of the series of x-ray images where the 

object of interest is not sufficiently filled with the contrast medium. 

12. Computer program for processing a series of x-ray images of an object of interest 
wherein the object of interest is visible due to a contrast medium, wherein the computer 
1 5 program is adapted to cause a processor to perform the following operation when the 
computer program is executed on the processor: 

automatically determining an image of the series of x-ray images where the 
object of interest is not sufficiently filled with the contrast medium. 
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ABSTRACT 

Automatic contrast medium control in images 

During catheter or guide wire intervention, a road map o£ for example, the coronary 
vessel tree based on pre-interventional angiograms is displayed. This road map, 
5 however, is naturally static and hence not consistent with the instantaneous heart and 
respiration cycles in the life image, which may be displayed on the screen next to the 
road map. According to an exemplary embodiment of the present invention, images of a 
series of x-ray images of an object of interest are determined, where the object of 
interest is not sufficiently filled with the contrast agent Advantageously, these images 
1 0 may be used to provide for an improved road map. 
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